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METHOD AND DEVICE FOR NOISE REDUCTION 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application is a national stage application under 35 USC §37 1(c) of CT 
Application No. PCT/BE2004/000103, entitled "Method and Device for Noise Reduction," 
filed on July 12, 2004, which claims the priority of Australian Patent No. 2003903575, filed 
on July 11, 2003, and Australian Patent No. 2004901931, filed on April 8, 2004. The entire 
disclosure and contents of the above applications are hereby incorporated by reference herein. 

BACK G ROUND /^/ of the Invention 

BACKGROUND 

Field of the Invention 

[0002] The present invention is related to a method and device for adaptively reducing 

the noise in speech communication applications. 

Related Art 

[0003] There are a variety of medical implants which deliver electrical stimulation to a 
patient or recipient ("recipient" herein) for a variety of therapeutic benefits. For example, the 
hair cells of the cochlea of a normal healthy ear convert acoustic signals into nerve impulses. 
People who are profoundly deaf due to the absence or destruction of cochlea hair cells are 
unable to derive suitable benefit from conventional hearing aid systems. Prosthetic hearing 
implant systems have been developed to provide such persons with the ability to perceive 
sound. Prosthetic hearing implant systems bypass the hair cells in the cochlea to directly 
deliver electrical stimulation to auditory nerve fibers, thereby allowing the brain to perceive a 
hearing sensation resembling the natural hearing sensation. 

[0004] The electrodes implemented in stimulating medical implants vary according to the 
device and tissue which is to be stimulated. For example, the cochlea is tonotopically 
mapped and partitioned into regions, with each region being responsive to stimulus signals in 
a particular frequency range. To accommodate this property of the cochlea, prosthetic 
hearing implant systems typically include an array of electrodes each constructed and 
arranged to deliver an appropriate stimulating signal to a particular region of the cochlea. 
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[0005] To achieve an optimal electrode position close to the inside wall of the cochlea, the 
electrode assembly should assume this desired position upon or immediately following 
implantation into the cochlea. It is also desirable that the electrode assembly be shaped such 
that the insertion process causes minimal trauma to the sensitive structures of the cochlea. 
Usually the electrode assembly is held in a straight configuration at least during the initial 
stages of the insertion procedure, conforming to the natural shape of the cochlear once 
implantation is complete. 

[0006] Prosthetic hearing implant systems typically have two primary components: an 
external component commonly referred to as a speech processor, and an implanted 
component commonly referred to as a receiver/stimulator unit. Traditionally, both of these 
components cooperate with each other to provide sound sensations to a recipient. 

[0007] The external component traditionally includes a microphone that detects sounds, 
such as speech and environmental sounds, a speech processor that selects and converts certain 
detected sounds, particularly speech, into a coded signal, a power source such as a battery, 
and an external transmitter antenna. 

[0008] The coded signal output by the speech processor is transmitted transcutaneously to 
the implanted receiver/stimulator unit, commonly located within a recess of the temporal 
bone of the recipient. This transcutaneous transmission occurs via the external transmitter 
antenna which is positioned to communicate with an implanted receiver antenna disposed 
within the receiver/stimulator unit. This communication transmits the coded sound signal 
while also providing power to the implanted receiver/stimulator unit. Conventionally, this 
link has been in the form of a radio frequency (RF) link, but other communication and power 
links have been proposed and implemented with varying degrees of success. 

[0009] The implanted receiver/stimulator unit traditionally includes the noted receiver 
antenna that receives the coded signal and power from the external component. The 
implanted unit also includes a stimulator that processes the coded signal and outputs an 
electrical stimulation signal to an intra-cochlea electrode assembly mounted to a carrier 
member. The electrode assembly typically has a plurality of electrodes that apply the 
electrical stimulation directly to the auditory nerve to produce a hearing sensation 
corresponding to the original detected sound. 
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SUMMARY 

[0010] In one aspect of the present invention, a method to reduce noise in a noisy speech 
signal is disclosed The method comprises applying at least two versions of the noisy speech 
signal to a first filter, whereby that first filter outputs a speech reference signal and at least 
one noise reference signal, applying a filtering operation to each of the at least one noise 
reference signals, and subtracting from the speech reference signal each of the filtered noise 
reference signals, wherein the filtering operation is performed with filters having filter 
coefficients determined by taking into account speech leakage contributions in the at least 
one noise reference signal. 

[0011] In another aspect of the invention to a signal processing circuit for reducing noise 
in a noisy speech signal, is enclosed. This signal processing circuit comprises a first filter 
having at least two inputs and arranged for outputting a speech reference signal and at least 
one noise reference signal, a filter to apply the speech reference signal to and filters to apply 
each of the at least one noise reference signals to, and summation means for subtracting from 
the speech reference signal the filtered speech reference signal and each of the filtered noise 
reference signals. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] Fig. 1 represents the concept of the Generalised Sidelobe Canceller in accordance 
with one embodiment of the present invention. 

[0013] Fig. 2 represents an equivalent approach of multi-channel Wiener filtering in 
accordance with one embodiment of the present invention. 

[0014] Fig. 3 represents a Spatially Pre-processed SDW-MWF in accordance with one 
embodiment of the present invention. 

[0015] Fig. 4 represents the decomposition of SP-SD W-MWF with wo in a multi-channel 
filter w d and single-channel postfilter ei-wo in accordance with one embodiment of the present 
invention. 

[0016] Fig. 5 represents the set-up for the experiments in accordance with one 
embodiment of the present invention. 
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[0017] Fig. 6 represents the influence of \/fi on the performance of the SDR GSC for 
different gain mismatches T 2 at the second microphone in accordance with one embodiment 
of the present invention. 

[0018] Fig. 7 represents the influence of l/ju on the performance of the SP-SDW-MWF 
with w 0 for different gain mismatches Y 2 at the second microphone in accordance with one 
embodiment of the present invention. 

[0019] Fig. 8 represents the ASNR inte iiig and SD in teUi g for QIC-GSC as a function of / for 
different gain mismatches T 2 at the second microphone in accordance with one embodiment 
of the present invention. 

[0020] Fig. 9 represents the complexity of TD and FD Stochastic Gradient (SG) algorithm 
with LP filter as a function of filter length L per channel; M=3 (for comparison, the 
complexity of the standard NLMS ANC and SPA are depicted too) in accordance with one 
embodiment of the present invention. 

[0021] Fig. 10 represents the performance of different FD Stochastic Gradient (FD-SG) 
algorithms; (a) Stationary speech-like noise at 90°; (b) Multi-talker babble noise at 90° in 
accordance with one embodiment of the present invention. 

[0022] Fig. 1 1 represents the influence of the LP filter on performance of FD stochastic 
gradient SP-SDW-MWF (l//i=0.5) without w 0 and with w 0 . Babble noise at 90° in 
accordance with one embodiment of the present invention. 

[0023] Fig. 12 represents the convergence behaviour of FD-SG for 1=0 and 1=0.9998. 
The noise source position suddenly changes from 90° to 180° and vice versa in accordance 
with one embodiment of the present invention. 

[0024] Fig. 13 represents the performance of FD stochastic gradient implementation of 
SP-SDW-MWF with LP filter (1=0.9998) in a multiple noise source scenario in accordance 
with one embodiment of the present invention. 

[0025] Fig. 14 represents the performance of FD SPA in a multiple noise source scenario 
in accordance with one embodiment of the present invention. 
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[0026] Fig. 15 represents the SNR improvement of the frequency-domain SP-SDW-MWF 
(Algorithm 2 and Algorithm 4) in a multiple noise source scenario in accordance with one 
embodiment of the present invention. 

[0027] Fig. 16 represents the speech distortion of the frequency-domain SP-SDW-MWF 
(Algorithm 2 and Algorithm 4) in a multiple noise source scenario in accordance with one 
embodiment of the present invention. 

DETAILED DESCRIPTION 
[0028] In speech communication applications, such as teleconferencing, hands-free 
telephony and hearing aids, the presence of background noise may significantly reduce the 
intelligibility of the desired speech signal. Hence, the use of a noise reduction algorithm is 
necessary. Multi-microphone systems exploit spatial information in addition to temporal and 
spectral information of the desired signal and noise signal and are thus preferred to single 
microphone procedures. Because of aesthetic reasons, multi-microphone techniques for e.g., 
hearing aid applications go together with the use of small-sized arrays. Considerable noise 
reduction can be achieved with such arrays, but at the expense of an increased sensitivity to 
errors in the assumed signal model such as microphone mismatch, reverberation, ... (see e.g. 
Stadler & Rabinowitz, 'On the potential of fixed arrays for hearing aids ', J. Acoust. Soc. 
Amer., vol. 94, no. 3, pp. 1332-1342, Sep. 1993) In hearing aids, microphones are rarely 
matched in gain and phase. Gain and phase differences between microphone characteristics 
can amount up to 6 dB and 10°, respectively. 

[0029] A widely studied multi-channel adaptive noise reduction algorithm is the 

Generalised Sidelobe Canceller (GSC) (see e.g. Griffiths & Jim, An alternative approach to 
linearly constrained adaptive beamforming', IEEE Trans. Antennas Propag, vol. 30, no. 1, 
pp. 27-34, Jan. 1982 and US5473701 Adaptive microphone array'). The GSC consists of a 
fixed, spatial pre-processor, which includes a fixed beamformer and a blocking matrix, and 
an adaptive stage based on an Adaptive Noise Canceller (ANC). The ANC minimizes the 
output noise power while the blocking matrix should avoid speech leakage into the noise 
references. The standard GSC assumes the desired speaker location, the microphone 
characteristics and positions to be known, and reflections of the speech signal to be absent. If 
these assumptions are fulfilled, it provides an undistorted enhanced speech signal with 
minimum residual noise. However, in reality these assumptions are often violated, resulting 
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in so-called speech leakage and hence speech distortion. To limit speech distortion, the ANC 
is typically adapted during periods of noise only. When used in combination with small-sized 
arrays, e.g., in hearing aid applications, an additional robustness constraint (see Cox et at, 
'Robust adaptive beamforming ', IEEE Trans. Acoust. Speech and Signal Processing', vol. 35, 
no. 10, pp. 1365-1376, Oct. 1987) is required to guarantee performance in the presence of 
small errors in the assumed signal model, such as microphone mismatch. A widely applied 
method consists of imposing a Quadratic Inequality Constraint to the ANC (QIC-GSC). For 
Least Mean Squares (LMS) updating, the Scaled Projection Algorithm (SPA) is a simple and 
effective technique that imposes this constraint. However, using the QIC-GSC goes at the 
expense of less noise reduction. 

[0030] A Multi-channel Wiener Filtering (MWF) technique has been proposed (see 

Doclo & Moonen, 'GSVD-based optimal filtering for single and multimicrophone speech 
enhancement', IEEE Trans. Signal Processing, vol. 50, no. 9, pp. 2230-2244, Sep. 2002) that 
provides a Minimum Mean Square Error (MMSE) estimate of the desired signal portion in 
one of the received microphone signals. In contrast to the ANC of the GSC, the MWF is able 
to take speech distortion into account in its optimisation criterion, resulting in the Speech 
Distortion Weighted Multi-channel Wiener Filter (SDW-MWF). The (SDW-)MWF 
technique is uniquely based on estimates of the second order statistics of the recorded speech 
signal and the noise signal. A robust speech detection is thus again needed. In contrast to the 
GSC, the (SDW-)MWF does not make any a priori assumptions about the signal model such 
that no or a less severe robustness constraint is needed to guarantee performance when used 
in combination with small-sized arrays. Especially in complicated noise scenarios such as 
multiple noise sources or diffuse noise, the (SDW-)MWF outperforms the GSC, even when 
the GSC is supplemented with a robustness constraint. 

[0031] A possible implementation of the (SDW-)MWF is based on a Generalised 

Singular Value Decomposition (GSVD) of an input data matrix and a noise data matrix. A 
cheaper alternative based on a QR Decomposition (QRD) has been proposed in Rombouts & 
Moonen, 'QRD-based unconstrained optimal filtering for acoustic noise reduction ', Signal 
Processing, vol. 83, no. 9, pp. 1889-1904, Sep. 2003. Additionally, a subband implementation 
results in improved intelligibility at a significantly lower cost compared to the fullband 
approach. However, in contrast to the GSC and the QIC-GSC, no cheap stochastic gradient 
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based implementation of the (SDW-)MWF is available yet. In Nordholm et ah, 'Adaptive 
microphone array employing calibration signals: an analytical evaluation ', IEEE Trans. 
Speech, Audio Processing, vol. 7, no. 3, pp. 241-252, May 1999, an LMS based algorithm for 
the MWF has been developed. However, said algorithm needs recordings of calibration 
signals. Since room acoustics, microphone characteristics and the location of the desired 
speaker change over time, frequent re-calibration is required, making this approach 
cumbersome and expensive. Also an LMS based SDW-MWF has been proposed that avoids 
the need for calibration signals (see Florencio & Malvar, 'Multichannel filtering for optimum 
noise reduction in microphone arrays', Int. Conf. on Acoust., Speech, and Signal Proc, Salt 
Lake City, USA, pp. 197-200, May 2001). This algorithm however relies on some 
independence assumptions that are not necessarily satisfied, resulting in degraded 
performance. 

[0032] The GSC and MWF techniques are now presented more in detail. 
Generalized Sidelobe Canceller (GSC) 

[0033] Fig. 1 describes the concept of the Generalized Sidelobe Canceller (GSC), which 
consists of a fixed, spatial pre-processor, i.e. a fixed beamformer A(z) and a blocking matrix 
B(z), and an ANC. Given M microphone signals 

U;[k] = U;[k] + u"[k], i = l,...,M (equation 1) 

with u.[k] the desired speech contribution and u"[k] the noise contribution, the fixed 
beamformer A(z) (e.g. delay-and-sum) creates a so-called speech reference 

Jo ffl = Jo + yl [£]> (equation 2) 

by steering a beam towards the direction of the desired signal, and comprising a speech 
contribution _v ( ,[/c] and a noise contribution y' n [k]. The blocking matrix5(z) creates M- 1 so- 
called noise references 

y i [k] = y-[k] + y"[k], i = \,...,M-\ (equation 3) 
by steering zeroes towards the direction of the desired signal source such that the noise 
contributions y" [k] are dominant compared to the speech leakage contributions y] [k] . In the 
sequel, the superscripts s and n are used to refer to the speech and the noise contribution of a 
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signal. During periods of speech + noise, the references y^k], i=0...M-l contain speech + 
noise. During periods of noise only, the references only consist of a noise component, i.e. 
y i [k] = y"[k]. The second order statistics of the noise signal are assumed to be quite 
stationary such that they can be estimated during periods of noise only. 

[0034] To design the fixed, spatial pre-processor, assumptions are made about the 
microphone characteristics, the speaker position and the microphone positions and 
furthermore reverberation is assumed to be absent. If these assumptions are satisfied, the 
noise references do not contain any speech, i.e., y°[k] = 0, for i=l,..., M-l. However, in 
practice, these assumptions are often violated (e.g. due to microphone mismatch and 
reverberation) such that speech leaks into the noise references. To limit the effect of such 
speech leakage, the ANC filter w 1:M _, e C (M_1)ixl 

<m-i=[< wf ... w£_,] (equation 4) 

where 

w,=[w,[0] w,.[l] ... w^L-lyf, (equation 5) 

with L the filter length, is adapted during periods of noise only. (Note that in a time-domain 
implementation the input signals of the adaptive filter w 1:M -i and the filter wi.-m-i are real. In 
the sequel the formulas are generalised to complex input signals such that they can also be 
applied to a subband implementation.) Hence, the ANC filter wi :M -i minimises the output 
noise power, i.e. 

w i:m-i = ar § m] n [k-&\- w" M _! [kV^ [kf\ (equation 6) 

leading to 

w 1:M _, = ^{y: :M _ 1 [-t]y^_ 1 [A:]}- 1 ^{y 1 " M _ 1 [A:]j; 0 K -*[A: - A]}, (equation 7) 

where 

y^t*] = [>,"•"[*] y" 2 ' H [k] ... y^W] (equations) 
ym = [y"ik] y"[k-l] ... y^k-L + l]]' (equation 9) 
and where A is a delay applied to the speech reference to allow for non-causal taps in the 
filter WiM-h The delay A is usually set to [-f ] , where [x] denotes the smallest integer equal 
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to or larger thanx. The subscript 1:M-1 in w 1:M -i and yi-.u-i refers to the subscripts of the first 
and the last channel component of the adaptive filter and input vector, respectively. 

[0035] Under ideal conditions (y s i \_k\ = 0, i = \,...,M -1), the GSC minimises the residual 
noise while not distorting the desired speech signal, i.e. z s [k] = y^[k - A] . However, when 
used in combination with small-sized arrays, a small error in the assumed signal model 
(resulting in y.[k]*0, z' = l,...,M-l) already suffices to produce a significantly distorted 
output speech signal z"[k] 

z s [k] = y;[k-A]-^ M _ l f l:M _ ] [kl (equation 10) 

even when only adapting during noise-only periods, such that a robustness constraint on wi.-m- 
i is required. In addition, the fixed beamformer A(z) should be designed such that the 
distortion in the speech reference y s 0 [k] is minimal for all possible model errors. In the 
sequel, a delay-and-sum beamformer is used. For small-sized arrays, this beamformer offers 
sufficient robustness against signal model errors, as it minimises the noise sensitivity. The 
noise sensitivity is defined as the ratio of the spatially white noise gain to the gain of the 
desired signal and is often used to quantify the sensitivity of an algorithm against errors in the 
assumed signal model. When statistical knowledge is given about the signal model errors that 
occur in practice, the fixed beamformer and the blocking matrix can be further optimised. 

[0036] A common approach to increase the robustness of the GSC is to apply a Quadratic 
Inequality Constraint (QIC) to the ANC filter w 1:M -i, such that the optimisation criterion 
(eq.6Error! Reference source not found.) (eq. 6) of the GSC is modified into 

w^_ 1 =aigmin£{|^ 0 "[*-A]-wS,_ 1 [*]yJ J# _ 1 [*]| 2 } . )n 

w i*-i 1 1 (equation 11) 

subject to w^ M _ ] w ]:M _ 1 < fi 2 . 
The QIC avoids excessive growth of the filter coefficients wim-u Hence, it reduces the 
undesired speech distortion when speech leaks into the noise references. 
The QIC-GSC can be implemented using the adaptive scaled projection algorithm (SPA)_: at 
each update step, the quadratic constraint is applied to the newly obtained ANC filter by 
scaling the filter coefficients by when w^_ 1 w 1:M _ 1 exceeds fi 2 . Recently, Tian et al. 

implemented the quadratic constraint by using variable loading ('Recursive least squares 
implementation for LCMP Beamforming under quadratic constraint', IEEE Trans. Signal 
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Processing, vol. 49, no. 6, pp. 1138-1145, June 2001). For Recursive Least Squares (RLS), 
this technique provides a better approximation to the optimal solution 
(eq.Error! R e f e r e nc e sourc e not found. 1 1) (eg. 11) than the scaled projection algorithm. 

Multi-Channel Wiener Filtering (MWF) 

[0037] The Multi-channel Wiener filtering (MWF) technique provides a Minimum Mean 
Square Error (MMSE) estimate of the desired signal portion in one of the received 
microphone signals. In contrast to the GSC, this filtering technique does not make any a 
priori assumptions about the signal model and is found to be more robust. Especially in 
complex noise scenarios such as multiple noise sources or diffuse noise, the MWF 
outperforms the GSC, even when the GSC is supplied with a robustness constraint. 

[0038] The MWF w 1; „eC w " minimises the Mean Square Error (MSE) between a 
delayed version of the (unknown) speech signal wf[/c-A] at the z'-th (e.g. first) microphone 
and the sum w?mU 1:M [/<:] of the M filtered microphone signals, i.e. 

Wi : M = argmm^{|<[/c-A]-wS/U 1:M [A:]| 2 j, (equation 12) 

leading to 

Wl:M = E {u 1:M [k]u" M [k] f [ E {u l:M [k]u°'' [k - A] }, (equation 13) 

with 

wS/ = [wf wf ••• 4], (equation 14) 

= [uf[*] uf[/t] - u H M [k]\, (equation 15) 
u,.[/c] = [u,[k] u^k-l] ■■■ u^k-L + ltf. (equation 16) 
where u;[k] comprise a speech component and a noise component. 

[0039] An equivalent approach consists in estimating a delayed version of the (unknown) 
noise signal u"[k- A] in the z'-th microphone, resulting in 

w rM =argmin£ , ||w j "[/c-A]-wf M u 1 . M [/c]| 2 |, (equation 17) 

and 
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w 1:M = J E{u 1:M [^]u^[A;]}- 1 J E{u 1:M [A;K'*[^-A]},(equation 18) 

where 

w ?M=[ w f w f ••• W S]- (equation 19) 

The estimate z[k] of the speech component u°[k-A] is then obtained by subtracting the 
estimate Yf" M u 1M [k] of u"[k-A] from the delayed, z'-th microphone signal u^k-A], i.e. 

z[k] = u t [k - A] - w" M u l:M [k]. (equation 20) 

This is depicted in Fig. 2 for u" [k-A] = u"[k-A]. 
[0040] The residual error energy of the MWF equals 

E{\ e[k] \ 2 } = E{\u: [k - A] - [kf}, (equation 2 1 ) 

and can be decomposed into 

E{\u; [k - A] - iv>; :M [kf} + E{\^ M u" l:M [kf} (equation 22) 

where s] equals the speech distortion energy and s] the residual noise energy. The design 
criterion of the MWF can be generalised to allow for a trade-off between speech distortion 
and noise reduction, by incorporating a weighting factor fi with \i e [0,oo] 

Wl:M = argmin E{\u![k- A]- ^ M \i[ M [kf} + ^£{| w £X :W [/c]|Y (equation 23) 

The solution of (eq. 23Error! Reference source not found.) (eq. 23) is given by 

W1: m = E {Uj. M [k ]u\:^ [k ] + /ju". m [k]u";^ [k]}' 1 E{u[ M [k~\u s :* [k - A] } . (equation 24) 

[0041] Equivalently, the optimisation criterion for wi :M -i in (eqr 
17Error! Reference source not found.) (eq. 17) can be modified into 

w 1:M = arg min £{|w? M u* M [kf} + iiE^ [k - A] - w? M u", M [kf\, (equation 25) 
resulting in 

w rM = Eiu^lkX.f^k] + -ul M [k]u s 1 :^[k]} 1 E{a" 1 . M [kX''[k - A]}, (equation 26) 

In the sequel, (cq.Error! Reference source not found.) (eq. 26) will be referred to as the 
Speech Distortion Weighted Multi-channel Wiener Filter (SDW-MWF). 
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The factor /j e[0,co] trades off speech distortion versus noise reduction. If //=1, the MMSE 

criterion (eq-. 12Error! Reference source net found.) or (6% 

17Error! Reference source not found.) (eg. 12) or (eg. 17) is obtained. If n>\, the residual 
noise level will be reduced at the expense of increased speech distortion. By setting ju to qo, 
all emphasis is put on noise reduction and speech distortion is completely ignored. Setting ju 
to 0 on the other hand, results in no noise reduction. 

[0042] In practice, the correlation matrix £{u^[£]u^[A:]} is unknown. During periods 
of speech, the inputs u t [k] consist of speech + noise, i.e., u,[k] = u°[k] + u?[k],i = l,...,M . 
During periods of noise, only the noise component u"[k] is observed. Assuming that the 
speech signal and the noise signal are uncorrected, isfuJ^^u^fA:]} can be estimated as 

%[t]u^W} = ^{Ui:J*]U|*W}-£K*[*]"S?W}. (eguation27) 
where the second order statistics E{u lM [k]u" M [k]} are estimated during speech + noise and 
the second order statistics E{u". M [k]u":^[k]} during periods of noise only. As for the GSC, a 
robust speech detection is thus needed. Using ( e g.Error! Reference source not found. 27), 
(eg.Error! Reference source not found. 2 4 ) and ( e g.Error! Reference source not found. 
36) (eg. 27). (eg. 24) and (eg. 26) can be re-written as: 

w 1:M = (^{u 1:M [A:K M [A:]} + ( A1 -l)^K :M [A:]u^[A:]})" 1 
x(E{n, M [k]u;[k-A]}-E{nl M [k]ur[k-A]}) 

(eguation 28) 

and w 1:M =|^{u 1:M KW}+(l-VK M [^[i]}j E{u» :M [k]ur[k-A]}. 

(eguation 29) 

The Wiener filter may be computed at each time instant k by means of a Generalised 
Singular Value Decomposition (GSVD) of a speech + noise and noise data matrix. A cheaper 
recursive alternative based on a QR-decomposition is also available. Additionally, a subband 
implementation increases the resulting speech intelligibility and reduces complexity, making 
it suitable for hearing aid applications. 
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[0043] The present invention is now described in detail. First, the proposed adaptive 
multi-channel noise reduction technique, referred to as Spatially Pre-processed Speech 
Distortion Weighted Multi-channel Wiener filter, is described. 

[0044] A first aspect of the invention is referred to as Speech Distortion Regularised GSC 
(SDR-GSC). A new design criterion is developed for the adaptive stage of the GSC: the ANC 
design criterion is supplemented with a regularisation term that limits speech distortion due to 
signal model errors. In the SDR-GSC, a parameter // is incorporated that allows for a trade- 
off between speech distortion and noise reduction. Focussing Focusing all attention towards 
noise reduction, results in the standard GSC, while, on the other hand, focussing focusing all 
attention towards speech distortion results in the output of the fixed beamformer. In noise 
scenarios with low SNR, adaptivity in the SDR-GSC can be easily reduced or excluded by 
increasing attention towards speech distortion, i.e., by decreasing the parameter ju to 0. The 
SDR-GSC is an alternative to the QIC-GSC to decrease the sensitivity of the GSC to signal 
model errors such as microphone mismatch, reverberation,... In contrast to the QIC-GSC, the 
SDR-GSC shifts emphasis towards speech distortion when the amount of speech leakage 
grows. In the absence of signal model errors, the performance of the GSC is preserved. As a 
result, a better noise reduction performance is obtained for small model errors, while 
guaranteeing robustness against large model errors. 

[0045] In a next step, the noise reduction performance of the SDR-GSC is further 
improved by adding an extra adaptive filtering operation w 0 on the speech reference signal. 
This generalised scheme is referred to as Spatially Pre-processed Speech Distortion Weighted 
Multi-channel Wiener Filter (SP-SDW-MWF). The SP-SDW-MWF is depicted in Fig. 3 and 
encompasses the MWF as a special case. Again, a parameter ju is incorporated in the design 
criterion to allow for a trade-off between speech distortion and noise reduction. Focussing 
Focusing all attention towards speech distortion, results in the output of the fixed 
beamformer. Also here, adaptivity can be easily reduced or excluded by decreasing ju to 0. It 
is shown that -in the absence of speech leakage and for infinitely long filter lengths- the SP- 
SDW-MWF corresponds to a cascade of a SDR-GSC with a Speech Distortion Weighted 
Single-channel Wiener filter (SDW-SWF). In the presence of speech leakage, the SP-SDW- 
MWF with w 0 tries to preserve its performance: the SP-SDW-MWF then contains extra 
filtering operations that compensate for the performance degradation due to speech leakage. 
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Hence, in contrast to the SDR-GSC (and thus also the GSC), performance does not degrade 
due to microphone mismatch. Recursive implementations of the (SDW-)MWF exist that are 
based on a GSVD or QR decomposition. Additionally, a subband implementation results in 
improved intelligibility at a significantly lower complexity compared to the fullband 
approach. These techniques can be extended to implement the SDR-GSC and, more 
generally, the SP-SDW-MWF. 

[0046] In this invention, cheap time-domain and frequency-domain stochastic gradient 
implementations of the SDR-GSC and the SP-SDW-MWF are proposed as well. Starting 
from the design criterion of the SDR-GSC, or more generally, the SP-SDW-MWF, a time- 
domain stochastic gradient algorithm is derived. To increase the convergence speed and 
reduce the computational complexity, the algorithm is implemented in the frequency-domain. 
To reduce the large excess error from which the stochastic gradient algorithm suffers when 
used in highly no n- stationary noise, a low pass filter is applied to the part of the gradient 
estimate that limits speech distortion. The low pass filter avoids a highly time-varying 
distortion of the desired speech component while not degrading the tracking performance 
needed in time-varying noise scenarios. Experimental results show that the low pass filter 
significantly improves the performance of the stochastic gradient algorithm and does not 
compromise the tracking of changes in the noise scenario. In addition, experiments 
demonstrate that the proposed stochastic gradient algorithm preserves the benefit of the SP- 
SDW-MWF over the QIC-GSC, while its computational complexity is comparable to the 
NLMS based scaled projection algorithm for implementing the QIC. The stochastic gradient 
algorithm with low pass filter however requires data buffers, which results in a large memory 
cost. The memory cost can be decreased by approximating the regularisation term in the 
frequency-domain using (diagonal) correlation matrices, making an implementation of the 
SP-SDW-MWF in commercial hearing aids feasible both in terms of complexity as well as 
memory cost. Experimental results show that the stochastic gradient algorithm using 
correlation matrices has the same performance as the stochastic gradient algorithm with low 
pass filter. 

Spatially pre-processed SDW Multi-channel Wiener Filter 
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Concept 

[0047] Fig. 3 depicts the Spatially pre-processed, Speech Distortion Weighted Multi- 
channel Wiener filter (SP-SDW-MWF). The SP-SDW-MWF consists of a fixed, spatial pre- 
processor, i.e. a fixed beamformer A(z) and a blocking matrix B(z), and an adaptive Speech 
Distortion Weighted Multi-channel Wiener filter (SDW-MWF). Given M microphone signals 

u t [k] = u'[k] + u"[k\i = l,...,M (equation 30) 

with u*[k] the desired speech contribution and u"[k] the noise contribution, the fixed 
beamformer A(z) creates a so-called speech reference 

Jo [k] = J o [k] + y" 0 [k\ (equation 3 1 ) 

by steering a beam towards the direction of the desired signal, and comprising a speech 
contribution y s 0 [k] and a noise contribution v 0 '[&]. To preserve the robustness advantage of 
the MWF, the fixed beamformer A(z) should be designed such that the distortion in the 
speech reference y s 0 [k] is minimal for all possible errors in the assumed signal model such as 
microphone mismatch. In the sequel, a delay-and-sum beamformer is used. For small-sized 
arrays, this beamformer offers sufficient robustness against signal model errors as it 
minimises the noise sensitivity. Given statistical knowledge about the signal model errors that 
occur in practice, a further optimised filter-and-sum beamformer A(z) can be designed. The 
blocking matrix B(z) creates M-l so-called noise references 

y,[k] = y-[k] + y"[k], i = \,...,M-\ (equation 32) 
by steering zeroes towards the direction of interest such that the noise contributions y"[k] are 
dominant compared to the speech leakage contributions y*[k]. A simple technique to create 
the noise references consists of pairwise subtracting the time-aligned microphone signals. 
Further optimised noise references can be created, e.g. by minimising speech leakage for a 
specified angular region around the direction of interest instead of for the direction of interest 
only (e.g. for an angular region from -20° to 20° around the direction of interest). In addition, 
given statistical knowledge about the signal model errors that occur in practice, speech 
leakage can be minimised for all possible signal model errors. 

[0048] In the sequel, the superscripts s and n are used to refer to the speech and the noise 
contribution of a signal. During periods of speech + noise, the references y t [k], 
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z = 0,...,M-1 contain speech + noise. During periods of noise only, y t [k\ i=0,...,M-l only 
consist of a noise component, i.e. y ; [k] = y"[k] . The second order statistics of the noise 
signal are assumed to be quite stationary such that they can be estimated during periods of 
noise only. 

[0049] The SDW-MWF filter w 0:M -i 

^^^Eiyi^ikw* E{r,. M _myr\.k-^}, 

(equation 33) 

with 

< M -m = [<{k] wf[/c] ... <_,[*]], (equation 34) 
w,.[/c] = [h>,.[0] w,.[l] ... w t [L-l]] T (equation 35) 
yL-iW = [y^W yfW - y£-it*]]. (equation 36) 
y,W = [j,.W y,[k-l] ... y t \k - L + l]f, (equation 37) 

provides an estimate w^^y,,.^! [k] of the noise contribution y" 0 [k-A] in the speech 

reference by minimising the cost function J(wom-i) 

jfroM-i ) = ^ ^hv.y^-.wr} + E{\/ 0 [k-*]-v'L-y» M - 1 [ki\ ■ 

(equation 38) 

The subscript 0:M-1 in wo-.m-i andj^o.M-/ refers to the subscripts of the first and the last channel 
component of the adaptive fdter and the input vector, respectively. The term c] represents 
the speech distortion energy and e 2 n the residual noise energy. The term ^s] in the cost 
function (eq.38) limits the possible amount of speech distortion at the output of the SP-SDW- 
MWF. Hence, the SP-SDW-MWF adds robustness against signal model errors to the GSC by 
taking speech distortion explicitly into account in the design criterion of the adaptive stage. 
The parameter -e[0,oo) trades off noise reduction and speech distortion: the larger l/ju, the 
smaller the amount of possible speech distortion. For /u=0, the output of the fixed 
beamformer A(z), delayed by A samples is obtained. Adaptivity can be easily reduced or 
excluded in the SP-SDW-MWF by decreasing fi to 0 (e.g., in noise scenarios with very low 
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signal-to-noise Ratio (SNR), e.g., -10 dB, a fixed beamformer may be preferred.) 
Additionally, adaptivity can be limited by applying a QIC to Wo.m-i- 

[0050] Note that when the fixed beamformer A(z) and the blocking matrix B(z) are set to 



A(z) = [l 0 .. 
1 0 



B(z) = 



of 



1 0 
0 1 



(equation 39) 



(equation 40) 



one obtains the original SDW-MWF that operates on the received microphone signals 
u^k], i = \,...,M. 

[0051] Below, the different parameter settings of the SP-SDW-MWF are discussed. 
Depending on the setting of the parameter ju and the presence or the absence of the filter wo, 
the GSC, the (SDW-)MWF as well as in-between solutions such as the Speech Distortion 
Regularised GSC (SDR-GSC) are obtained. One distinguishes between two cases, i.e. the 
case where no filter wo is applied to the speech reference (filter length L 0 =0) and the case 
where an additional filter w 0 is used (L#0). 



SDR-GSC. i.e.. SP-SDW-MWF without w „ 

[0052] First, consider the case without w 0 , i.e. L 0 =0. The solution for w 1:M _! in (eq.33) 
then reduces to 

argmm^llw^y^Ml 2 } + ^{|j 0 "[^- *\-w% lt _y i:lt _ 1 [kf} , (equation 41) 
leading to 

(equation 42) 

where a] is the speech distortion energy and s 2 n the residual noise energy. 

[0053] Compared to the optimisation criterion (cq.6Error! Reference source not found.) 

(eq. 6) of the GSC, a regularisation term 
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— £{|w^_jyj. M _j[A:]| 2 } (equation 43) 

has been added. This regularisation term limits the amount of speech distortion that is caused 
by the filter wum-i when speech leaks into the noise references, i.e. y-[k] *0,i = \,...,M -1 . 
In the sequel, the SP-SDW-MWF with L 0 =0 is therefore referred to as the Speech Distortion 
Regularized GSC (SDR-GSC). The smaller //, the smaller the resulting amount of speech 
distortion will be. For ^=0, all emphasis is put on speech distortion such that z[k] is equal to 
the output of the fixed beamformer A(z) delayed by A samples. For //=qo all emphasis is put 
on noise reduction and speech distortion is not taken into account. This corresponds to the 
standard GSC. Hence, the SDR-GSC encompasses the GSC as a special case. 

[0054] The regularisation term (eq. 43) (eq. Error! Reference source not found.) with 
l///^0 adds robustness to the GSC, while not affecting the noise reduction performance in the 
absence of speech leakage: 

In the absence of speech leakage, i.e., y-[k] = 0, i = \,...,M -\, the regularisation 
term equals 0 for all w 1:M -i and hence the residual noise energy a] is effectively 
minimised. In other words, in the absence of speech leakage, the GSC solution is 
obtained. 

In the presence of speech leakage, i.e., y.[k] ^0, i = \,...,M -1 , speech distortion is 
explicitly taken into account in the optimisation criterion (eq.41) for the adaptive filter 
wi : m-i, limiting speech distortion while reducing noise. The larger the amount of 
speech leakage, the more attention is paid to speech distortion. 
To limit speech distortion alternatively, a QIC is often imposed on the filter wi-m-i- In contrast 
to the SDR-GSC, the QIC acts irrespective of the amount of speech leakage y s [k] that is 
present. The constraint value (i 2 in (eq.HError! Reference source not found.) (eq. 11) has 
to be chosen based on the largest model errors that may occur. As a consequence, noise 
reduction performance is compromised even when no or very small model errors are present. 
Hence, the QIC is more conservative than the SDR-GSC, as will be shown in the 
experimental results. 

SP-SDW-MWF with filter w n 
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[0055] Since the SDW-MWF (eq.33) takes speech distortion explicitly into account in its 
optimisation criterion, an additional filter wo on the speech reference y 0 [k] may be added. 
The SDW-MWF (eq.33) then solves the following more general optimisation criterion 



where w£ M „,=[w^ wf M _J is given by (eq.33). 

[0056] Again, ju trades off speech distortion and noise reduction. For ju=cc speech 
distortion a] is completely ignored, which results in a zero output signal. For ju=0 all 
emphasis is put on speech distortion such that the output signal is equal to the output of the 
fixed beamformcr delayed by A samples. 

In addition, the observation can be made that in the absence of speech leakage, i.e., 
y°[k] = 0, i=l,...,M-l and for infinitely long filters w,-, i=0,...,M-l, the SP-SDW-MWF 
(with wo) corresponds to a cascade of an SDR-GSC and an SDW single-channel WF (SDW- 
SWF) postfilter. In the presence of speech leakage, the SP-SDW-MWF (with wo) tries to 
preserve its performance: the SP-SDW-MWF then contains extra filtering operations that 
compensate for the performance degradation due to speech leakage. This is illustrated in Fig. 
4. It can e.g. be proven that, for infinite filter lengths, the performance of the SP-SDW-MWF 
(with wo) is not affected by microphone mismatch as long as the desired speech component at 
the output of the fixed beamformer A(z) remains unaltered. 

Experimental results 

[0057] The theoretical results are now illustrated by means of experimental results for a 
hearing aid application. First, the set-up and the performance measures used, are described. 
Next, the impact of the different parameter settings of the SP-SDW-MWF on the 



w o:m-i =argmin£ Uy' 0 





(equation 44) 
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performance and the sensitivity to signal model errors is evaluated. Comparison is made with 
the QIC-GSC. 

[0058] Fig. 5 depicts the set-up for the experiments. A three-microphone Behind-The-Ear 
(BTE) hearing aid with three omnidirectional microphones (Knowles FG-3452) has been 
mounted on a dummy head in an office room. The interspacing between the first and the 
second microphone is about 1 cm and the interspacing between the second and the third 
microphone is about 1.5 cm. The reverberation time T 60dB of the room is about 700 ms for a 
speech weighted noise. The desired speech signal and the noise signals are uncorrelated. Both 
the speech and the noise signal have a level of 70 dB SPL at the centre of the head. The 
desired speech source and noise sources are positioned at a distance of 1 meter from the head: 
the speech source in front of the head (0°), the noise sources at an angle 9 w.r.t. the speech 
source (see also Fig. 5). To get an idea of the average performance based on directivity only, 
stationary speech and noise signals with the same, average long-term power spectral density 
are used. The total duration of the input signal is 10 seconds of which 5 seconds contain noise 
only and 5 seconds contain both the speech and the noise signal. For evaluation purposes, the 
speech and the noise signal have been recorded separately. 

[0059] The microphone signals are pre-whitened prior to processing to improve 
intelligibility, and the output is accordingly de-whitened. In the experiments, the microphones 
have been calibrated by means of recordings of an anechoic speech weighted noise signal 
positioned at 0°, measured while the microphone array is mounted on the head. A delay-and- 
sum beamformer is used as a fixed beamformer, since -in case of small microphone 
interspacing - it is known to be very robust to model errors. The blocking matrix B pairwise 
subtracts the time aligned calibrated microphone signals. 

[0060] To investigate the effect of the different parameter settings (i.e. fi, w 0 ) on the 
performance, the filter coefficients are computed using (eq.33) where E{yl. M _ 1 y s ^_ 1 } is 
estimated by means of the clean speech contributions of the microphone signals. In practice, 
^{yo-M-iyo : M-i} i s approximated using (eq. 27). (eq.Error! R e f e r e nc e sourc e not found.27). 
The effect of the approximation (eq.Error! R e f e r e nc e sourc e not found.27) (eq. 27) on the 
performance was found to be small (i.e. differences of at most 0.5 dB in intelligibility 
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weighted SNR improvement) for the given data set. The QIC-GSC is implemented using 
variable loading RLS. The filter length L per channel equals 96. 

[0061] To assess the performance of the different approaches, the broadband intelligibility 
weighted SNR improvement is used, defined as 



where the band importance function h expresses the importance of the z'-th one-third octave 
band with centre frequency f c for intelligibility, SNRi. ou , is the output SNR (in dB) and 
SNRi, in is the input SNR (in dB) in the j-th one third octave band ("ANSI S3. 5-1997, American 
National Standard Methods for Calculation of the Speech Intelligibility Index'). The 
intelligibility weighted SNR reflects how much intelligibility is improved by the noise 
reduction algorithm, but does not take into account speech distortion. 

[0062] To measure the amount of speech distortion, we define the following intelligibility 
weighted spectral distortion measure 



with G s (f) the power transfer function of speech from the input to the output of the noise 
reduction algorithm. To exclude the effect of the spatial pre -processor, the performance 
measures are calculated w.r.t. the output of the fixed beamformer. 

[0063] The impact of the different parameter settings for ju and w 0 on the performance of 
the SP-SDW-MWF is illustrated for a five noise source scenario. The five noise sources are 
positioned at angles 75°, 120°, 180°, 240°, 285° w.r.t. the desired source at 0°. To assess the 
sensitivity of the algorithm against errors in the assumed signal model, the influence of 
microphone mismatch, e.g., gain mismatch of the second microphone, on the performance is 
evaluated. Among the different possible signal model errors, microphone mismatch was 
found to be especially harmful to the performance of the GSC in a hearing aid application. In 
hearing aids, microphones are rarely matched in gain and phase. Gain and phase differences 
between microphone characteristics of up to 6 dB and 10°, respectively, have been reported. 



ASNRinteiug = £ 7 < (SNR/.™t " SNR/,i„), (equation 45) 



SDintemg = X /, SDi (equation 46) 



with SD,- the average spectral distortion (dB) in z-th one -third band, measured as 
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SP-SDW-MWF without w n (SDR-GSC) 

[0064] Fig. 6 plots the improvement ASNRinteiiig and the speech distortion SD inte iii g as a 
function of l/ju obtained by the SDR-GSC (i.e., the SP-SDW-MWF without filter w 0 ) for 
different gain mismatches Y 2 at the second microphone. In the absence of microphone 
mismatch, the amount of speech leakage into the noise references is limited. Hence, the 
amount of speech distortion is low for all ju. Since there is still a small amount of speech 
leakage due to reverberation, the amount of noise reduction and speech distortion slightly 
decreases for increasing l/ju, especially for 1/// > 1. In the presence of microphone mismatch, 
the amount of speech leakage into the noise references grows. For 1/^=0 (GSC), the speech 
gets significantly distorted. Due to the cancellation of the desired signal, also the 
improvement ASNRinteiiig degrades. Setting l///>0 improves the performance of the GSC in 
the presence of model errors without compromising performance in the absence of signal 
model errors. For the given set-up, a value l/ju around 0.5 seems appropriate for guaranteeing 
good performance for a gain mismatch up to 4dB. 

SP-SDW-MWF with filter w n 

[0065] Fig. 7 plots the performance measures ASNRi nte iiig and SDmteUig of the SP-SDW- 
MWF with filter wo. In general, the amount of speech distortion and noise reduction grows 
for decreasing l//u. For l/ju=0, all emphasis is put on noise reduction. As also illustrated by 
Fig. 7, this results in a total cancellation of the speech and the noise signal and hence 
degraded performance. In the absence of model errors, the settings Lo=0 and LgfiO result - 
except for l/ju=0 - in the same ASNRi„ te m g , while the distortion for the SP-SDW-MWF with 
wo is higher due to the additional single-channel SDW-SWF. For Lo£0 the performance does 
-in contrast to L 0 =0- not degrade due to the microphone mismatch. 

[0066] Fig. 8 depicts the improvement ASNRinteiiig and the speech distortion SDi nte ni g , 
respectively, of the QIC-GSC as a function of p 2 . Like the SDR-GSC, the QIC increases the 
robustness of the GSC. The QIC is independent of the amount of speech leakage. As a 
consequence, distortion grows fast with increasing gain mismatch. The constraint value P 
should be chosen such that the maximum allowable speech distortion level is not exceeded 
for the largest possible model errors. Obviously, this goes at the expense of reduced noise 
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reduction for small model errors. The SDR-GSC on the other hand, keeps the speech 
distortion limited for all model errors (see Fig. 6). Emphasis on speech distortion is increased 
if the amount of speech leakage grows. As a result, a better noise reduction performance is 
obtained for small model errors, while guaranteeing sufficient robustness for large model 
errors. In addition, Fig. 7 demonstrates that an additional filter wo significantly improves the 
performance in the presence of signal model errors. 

[0067] In the previously discussed embodiments a generalised noise reduction scheme has 
been established, referred to as Spatially pre-processed, Speech Distortion Weighted Multi- 
channel Wiener Filter (SP-SDW-MWF) , that comprises a fixed, spatial pre-processor and an 
adaptive stage that is based on a SDW-MWF. The new scheme encompasses the GSC and 
MWF as special cases. In addition, it allows for an in-between solution that can be interpreted 
as a Speech Distortion Regularised GSC (SDR-GSC). Depending on the setting of a trade-off 
parameter ju and the presence or absence of the filter w 0 on the speech reference, the GSC, the 
SDR-GSC or a (SDW-)MWF is obtained. The different parameter settings of the SP-SDW- 
MWF can be interpreted as follows: 

• Without w 0 , the SP-SDW-MWF corresponds to an SDR-GSC: the ANC 
design criterion is supplemented with a regularisation term that limits the speech 
distortion due to signal model errors. The larger V/i, the smaller the amount of 
distortion. For 1/^=0, distortion is completely ignored, which corresponds to the 
GSC-solution. The SDR-GSC is then an alternative technique to the QIC-GSC to 
decrease the sensitivity of the GSC to signal model errors. In contrast to the QIC- 
GSC, the SDR-GSC shifts emphasis towards speech distortion when the amount of 
speech leakage grows. In the absence of signal model errors, the performance of the 
GSC is preserved. As a result, a better noise reduction performance is obtained for 
small model errors, while guaranteeing robustness against large model errors. 

• Since the SP-SDW-MWF takes speech distortion explicitly into account, 
a filter wo on the speech reference can be added. It can be shown that -in the absence 
of speech leakage and for infinitely long filter lengths- the SP-SDW-MWF 
corresponds to a cascade of an SDR-GSC with an SDW-SWF postfilter. In the 
presence of speech leakage, the SP-SDW-MWF with w 0 tries to preserve its 
performance: the SP-SDW-MWF then contains extra filtering operations that 
compensate for the performance degradation due to speech leakage. In contrast to the 
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SDR-GSC (and thus also the GSC), the performance does not degrade due to 
microphone mismatch. 

Experimental results for a hearing aid application confirm the theoretical results. The SP- 
SDW-MWF indeed increases the robustness of the GSC against signal model errors. A 
comparison with the widely studied QIC-GSC demonstrates that the SP-SDW-MWF achieves 
a better noise reduction performance for a given maximum allowable speech distortion level. 



Stochastic gradient implementations 

[0068] Recursive implementations of the (SDW-)MWF have been proposed based on a 
GSVD or QR decomposition. Additionally, a subband implementation results in improved 
intelligibility at a significantly lower cost compared to the fullband approach. These 
techniques can be extended to implement the SP-SDW-MWF. However, in contrast to the 
GSC and the QIC-GSC, no cheap stochastic gradient based implementation of the SP-SDW- 
MWF is available. In the present invention, time-domain and frequency-domain stochastic 
gradient implementations of the SP-SDW-MWF are proposed that preserve the benefit of 
matrix-based SP-SDW-MWF over QIC-GSC. Experimental results demonstrate that the 
proposed stochastic gradient implementations of the SP-SDW-MWF outperform the SPA, 
while their computational cost is limited. 

[0069] Starting from the cost function of the SP-SDW-MWF, a time-domain stochastic 
gradient algorithm is derived. To increase the convergence speed and reduce the 
computational complexity, the stochastic gradient algorithm is implemented in the frequency- 
domain. Since the stochastic gradient algorithm suffers from a large excess error when 
applied in highly time-varying noise scenarios, the performance is improved by applying a 
low pass filter to the part of the gradient estimate that limits speech distortion. The low pass 
filter avoids a highly time-varying distortion of the desired speech component while not 
degrading the tracking performance needed in time-varying noise scenarios. Next, the 
performance of the different frequency-domain stochastic gradient algorithms is compared. 
Experimental results show that the proposed stochastic gradient algorithm preserves the 
benefit of the SP-SDW-MWF over the QIC-GSC. Finally, it is shown that the memory cost 
of the frequency-domain stochastic gradient algorithm with low pass filter is reduced by 
approximating the regularisation term in the frequency-domain using (diagonal) correlation 
matrices instead of data buffers. Experiments show that the stochastic gradient algorithm 
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using correlation matrices has the same performance as the stochastic gradient algorithm with 
low pass filter. 

Stochastic gradient algorithm 

Derivation 

[0070] A stochastic gradient algorithm approximates the steepest descent algorithm, using 
an instantaneous gradient estimate. Given the cost function (eq.38), the steepest descent 
algorithm iterates as follows (note that in the sequel the subscripts 0:M-1 in the adaptive filter 
w 0 :M-i and the input vector y 0: M-i ar e omitted for the sake of conciseness): 

w[„ + l] = w W + f(-^} 

= w[»] + p^£{yItKlt-A]!-£|yl%""[*])w[»]-i£{y'[*]y' J 'm}w[ B ]j, 

(equation 48) 

with y?[k], y[k] e C NLxl , where N denotes the number of input channels to the adaptive filter 
and L the number of filter taps per channel. Replacing the iteration index n by a time index k 
and leaving out the expectation values E{.}, one obtains the following update equation 

W [i + l] = wW + p y'WW'^-Al-y'^^IiD-i/^rt™ • 

V I 

I r M J 

(equation 49) 

For l///=0 and no filter wo on the speech reference, (eq.49) reduces to the update formula 
used in GSC during periods of noise only (i.e., when y t [k] = y"[k], i = 0,...,M -1). The 
additional term r[k] in the gradient estimate limits the speech distortion due to possible signal 
model errors. 

[0071] Equation (49) requires knowledge of the correlation matrix y s [k] y s ' H [k] or 
E {y 5 [k]y s ' H [k]} of the clean speech. In practice, this information is not available. To avoid 
the need for calibration, speech + noise signal vectors y bufi are stored into a circular buffer 
Bj e i?^ xifa/1 during processing. During periods of noise only (i.e., when 
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y^k] = y"[k], i=0, ...,M-1), the filter w is updated using the following approximation of the 
term r[k] = j;y s [k]y s ' H [kMk] in (eq.49) 

^??*[kMk]«±(y„& l [k]-yy H [k])M.kl (equationSO) 
which results in the update formula 

w[k + 1] = w [k] + p y [*]( y 0 [k - A] - y H [k]w[k]) - i(y bufi [k]yl fi [k] - y[k]y H [*])w[*] .(equ 
[ nk] J 

ation 51) 

In the sequel, a normalised step size p is used, i.e. 

P=— j— z 7T- i z . (equation 52) 

i \yl A [k]y bufl [k] - y H [k]y[k]\ + y H [k]y [k] + S 

where 8 is a small positive constant. The absolute value jy^y^ - y H y\ has been inserted to 
guarantee a positive valued estimate of the clean speech energy y s ' H [k]y s [k] . Additional 
storage of noise only vectors y buh in a second buffer B 2 e R MxLb * allows to adapt w also 
during periods of speech + noise, using 

w[k + 1] = yy[k] + p jy^ [k](y^ [k-A]- y H buh [/c]w[/c]) + I(y^ [k]y H bu ^ [k] - y[k]y H [k]) w[/t]| 

(equation 53) 

with 

(equation 54) 



i \y H [k]y[k] - yl h [k] ybuf2 [k]\ + y^ [k]y^ [k] + 8 ' 
For reasons of conciseness only the update procedure of the time-domain stochastic gradient 
algorithms during noise only will be considered in the sequel, hence y[k]= y"[k]. The 
extension towards updating during speech + noise periods with the use of a second, noise 
only buffer B2 is straightforward: the equations are found by replacing the noise-only input 
vector y[k] by y buf2 [k] and the speech + noise vector y blffi [k] by the input speech + noise 
vector y[k]. 

It can be shown that the algorithm (eq.51)-(eq.52) is convergent in the mean provided that the 
step size p is smaller than 2/X max with the maximum eigenvalue of 
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^{jrYb^yhtfi + 0 ~j:)yy H ) ■ Tne similarity of (eq.51) with standard NLMS let us presume that 
setting p < with X u i=l,...,NL the eigenvalues of £{^y ia/i yf^ + (1— ^yy*} e fl JffixJffi , 

or -in case of FIR filters- setting 

2 

(equation 55) 



guarantees convergence in the mean square. Equation (55) explains the normalisation (eq.52) 
and (eq.54) for the step size p. 

[0072] However, since generally 

y[*]y " [k] * y"bu h [k]y" bu " [k], (equation 56) 

the instantaneous gradient estimate in (eq.51) is -compared to (eq.49)- additionally perturbed 
by 

^(yOTy^W-y^ [*]y$[*])w[*l (equation 57) 

for l/fi^O. Hence, for l/ju^O, the update equations (eq.51)-(eq.54) suffer from a larger 
residual excess error than (eq.49). This additional excess error grows for decreasing ju, 
increasing step size p and increasing vector length LN of the vector y. It is expected to be 
especially large for highly non-stationary noise, e.g. multi-talker babble noise. 
Remark that for jX>\, an alternative stochastic gradient algorithm can be derived from 
algorithm (eq.51)-(eq.54) by invoking some independence assumptions. Simulations, 
however, showed that these independence assumptions result in a significant performance 
degradation, while hardly reducing the computational complexity. 



Frequency-domain implementation 



[0073] As stated before, the stochastic gradient algorithm (eq.51)-(eq.54) is expected to 
suffer from a large excess error for large pVjii and/or highly time-varying noise, due to a large 
difference between the rank-one noise correlation matrices y"[k]y"' H [k] measured at 
different time instants k. The gradient estimate can be improved by replacing 

y bufl [k]yl fl [k]-y[k]y H [k] (equation 58) 
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^ t y^i^m-T i y[/]y " [/] ' ( ec i uation59 ) 

^ l=k-K+\ & l=k-K+\ 

where ic^, i =k _ K+i y bu^y^U] is updated during periods of speech + noise and 
Y^,, =k _ K+i yU]y"U] during periods of noise only. However, this would require expensive 
matrix operations. A block-based implementation intrinsically performs this averaging: 

w[(* + i)K] = v?[kK] + + *] (y'»\- kK +i-&]-y H [kK + z>m) 

- - Z (y W + nyl fi [kK + i] - y[kK + i]y H [kK + i]) w[kK] 

H i=o 

(equation 60) 

The gradient and hence also y bufi [k]yf ufi [k]-y[k]y H [k] is averaged over K iterations prior to 
making adjustments to w. This goes at the expense of a reduced (i.e. by a factor K) 
convergence rate. 

[0074] The block-based implementation is computationally more efficient when it is 
implemented in the frequency-domain, especially for large filter lengths : the linear 
convolutions and correlations can then be efficiently realised by FFT algorithms based on 
overlap-save or overlap-add. In addition, in a frequency-domain implementation, each 
frequency bin gets its own step size, resulting in faster convergence compared to a time- 
domain implementation while not degrading the steady-state excess MSE. 

[0075] Algorithm 1 summarises a frequency-domain implementation based on overlap- 
save of (eq.51)-(eq.54). Algorithm 1 requires (3N+4) FFTs of length 2L. By storing the FFT- 
transformed speech + noise and noise only vectors in the buffers Bj e c NxLbufl and 
B 2 g C NxLb " f2 , respectively, instead of storing the time-domain vectors, N FFT operations can 
be saved. Note that since the input signals are real, half of the FFT components are complex- 
conjugated. Hence, in practice only half of the complex FFT components have to be stored in 
memory. When adapting during speech + noise, also the time-domain vector 

[y 0 [kL-A] ■■■ y 0 [kL-A + L-\]] T (equation 61) 
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should be stored in an additional buffer B 2 0 e R lx ^ during periods of noise-only, which -for 

N=M- results in an additional storage of words compared to when the time-domain 
vectors are stored into the buffers Bi and B 2 . 

Remark that in Algorithm 1 a common trade-off parameter ju is used in all frequency bins. 
Alternatively, a different setting for ju can be used in different frequency bins. E.g. for SP- 
SDW-MWF with w 0 =0, Vju could be set to 0 at those frequencies where the GSC is 
sufficiently robust, e.g., for small-sized arrays at high frequencies. In that case, only a few 
frequency components of the regularisation terms Ri[k], i=M-N,...,M-l, need to be computed, 
reducing the computational complexity. 
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Algorithm 1 : Frequency-domain stochastic gradient SP-SDW-MWF based on overlap-save 
Initialisation: 

W,.[0] = [0 ••• Of, i = M-N,...,M-l 
P m [0] = 8 m , m = 0,...,2Z-l 

Matrix definitions: 

o = \ Il ° L ;k = r0, 1,1; F = 2Lx2L DFT matrix ; 

For each new block of NL input samples: 

♦ If noise detected: 

1. F[ yi [kL-L] ... y^kL + L-lyf, / = M -1 ^ noise buffer B 2 
[y 0 [kL-A] ... y 0 [kL-A + L-l]f -> noise buffer B 20 

2. Y;[k] = diag\¥[ yi [kL-L] ... y i [kL + L-\tf) > ,i = M -N,...,M -1 

d[*] = [;y 0 [tf-A] - j 0 [^-A + i-l]f 
Create Y;[k] from data in speech + noise buffer Bi. 

♦ If speech detected: 

1. F[j,.[£L-L] ... j j .[^L + L-l]] r ,/ = M-Af,...,M-l^ speech + noise buffer B, 

2. Y,[A;] = diag{F[>>,[*Z,-Z,] ... ^,[Ai + L-l]] r },/ = M-^,...,M-l 

Create d[k] and Y; n [£] from noise buffer B 2 ,o and B 2 

♦ Update formula: 

1. e,[*] = kF x",; v y ;otw,w = y«tj 

e[it] = d[Jt]-e 1 [Jt] 

e 2 [fc] = kF X-'u v Y yWW y [*] = y out , 2 

E,[*] = Fk^ME.W = Fk r e 2 [A:] ; E[/c] = Fk r e[£] 

2. A[k] = ^di ag {P 0 1 [kl...,P 2 t l [k]} 

P m [k] = yP m [k - 1] + (l - 7 ) \ Y l f + j\L%- n {K™ f - \ Y U 2 )\] 

3 . W, [ifc + 1] = W,[it] + FgF _1 A[A:] { Y/"'" [k]E[k] - ± ( Y*E 2 |7t] - Y/^Ej [it])} , 
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(i=M-N, ...,M-1) 



♦ Output: y 0 [k] = [y 0 [kL - A] ••• y 0 [kL- A + Z-l]f 



If noise detected: y out [A:] = y 0 [A;]-y outl [£:] 



If speech detected: y out [A:] = y 0 [k]-y out2 [k] 



Improvement 1; stochastic gradient algorithm with low pass filter 

[0076] For spectrally stationary noise, the limited (i.e. K=L) averaging of (eq.59) by the 
block-based and frequency-domain stochastic gradient implementation may offer a 
reasonable estimate of the short-term speech correlation matrix E{y s y s ' H ). However, in 
practical scenarios, the speech and the noise signals are often spectrally highly non-stationary 
(e.g. multi-talker babble noise) while their long-term spectral and spatial characteristics (e.g. 
the positions of the sources) usually vary more slowly in time. For these scenarios, a reliable 
estimate of the long-term speech correlation matrix E{y s y s,H } that captures the spatial rather 
than the short-term spectral characteristics can still be obtained by averaging (eq.59) over 
K»L samples. Spectrally highly non-stationary noise can then still be spatially suppressed 
by using an estimate of the long-term speech correlation matrix in the regularisation term 
r[k]. A cheap method to incorporate a long-term averaging (K»L) of (eq.59) in the 
stochastic gradient algorithm is now proposed, by low pass filtering the part of the gradient 
estimate that takes speech distortion into account (i.e. the term r[k] in (eq.51)). The averaging 
method is first explained for the time-domain algorithm (eq.51 )-(eq.54) and then translated to 
the frequency-domain implementation. 

Assume that the long-term spectral and spatial characteristics of the noise are quasi-stationary 
during at least K speech + noise samples and K noise samples. A reliable estimate of the long- 
term speech correlation matrix E{y s y s ' H } is then obtained by (eq.59) with K»L. To avoid 
expensive matrix computations, r[k] can be approximated by 



Since the filter coefficients w of a stochastic gradient algorithm vary slowly in time, (eq.62) 
appears a good approximation of r[k], especially for small step size p'. 
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The averaging operation (eq.62) is performed by applying a low pass filter to r[k] in 
(eq.Error! Reference source not found.): (eq. 51): 

r[k] = Xr[k - 1] + (1 - A) i(y Vi [Ar]y^ [k] - y[k]y H [k]) w[k], (equation 63) 

where X < 1 . This corresponds to an averaging window K of about samples. The 
normalised step size p is modified into 

p = §■ (equation 64) 

r avg [k]+y [k]y[k]+S 

r avg [k] = K vg [k-\] + (\-X)^\yl^ (equation 65) 

Compared to (eq.51), (eq.63) requires 3NL-1 additional MAC and extra storage of the NLxl 
vector r[k]. 

[0077] Equation (63) can be easily extended to the frequency-domain. The update 
equation for W r [k+1] in Algorithm 1 then becomes (Algorithm 2): 

W.[k + 1] = W,[it] + FgF-'A^Y/'" [k]E[k] - R,[*]) ; 

R, [it] = AR, [* - 1] + (1 - A)-(Y/ / [k]E 2 [k] - Y," M [itJEj [k]) 

(equation 66) 

with 

EW = Fk r |yoW-kF- 1 2 YJWWyW]; (equation 67) 
E 1 W = Fk r kF- 1 I] Y;[*]W y [*]; (equation 68) 

E 2 [*] = Fk r kF _1 2 Y yW W yW- (equation 69) 

y=M-iv 

and/l[£] computed as follows: 

A[k] = ^-diagfp- 1 ^],...,^^^]} (equation 70) 
p m [k] = yP m [k-l] + (l-y) (P lm [k] + P 2 m [k]) (equation 71) 
p iJW= S | Y ;.«^r (equation 72) 
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P 2m [k] = XP 2m [k-l] + (l-X)-\ £ [|Y 7 . m [yt]| 2 -|Y; m [A:]|l. (equation 73) 



A 1 \j=M-N ^ 



Compared to Algorithm 1, (eq.66)-(eq.69) require one extra 2Z-point FFT and 8NL-2N-2L 
extra MAC per L samples and additional memory storage of a 2NLxl real data vector. To 
obtain the same time constant in the averaging operation as in the time-domain version with 
K=l, X should equal % L . The experimental results that follow will show that the performance 
of the stochastic gradient algorithm is significantly improved by the low pass filter, especially 
for large X. 

[0078] Now the computational complexity of the different stochastic gradient algorithms 
is discussed. Table 1 summarises the computational complexity (expressed as the number of 
real multiply-accumulates (MAC), divisions (D), square roots (Sq) and absolute values 
(Abs)) of the time-domain (TD) and the frequency-domain (FD) Stochastic Gradient (SG) 
based algorithms. Comparison is made with standard NLMS and the NLMS based SPA. One 
complex multiplication is assumed to be equivalent to 4 real multiplications and 2 real 
additions. A 2L-point FFT of a real input vector requires 2Llog22L real MAC (assuming a 
radix-2 FFT algorithm). 

Table 1 indicates that the TD-SG algorithm without filter w 0 and the SPA are about twice as 
complex as the standard ANC. When applying a Low Pass filter (LP) to the regularisation 
term, the TD-SG algorithm has about three times the complexity of the ANC. The increase in 
complexity of the frequency-domain implementations is less. 

Algorithm update formula step size adaptation 

TD NLMS ANC (2M-2)L + 1)MAC 1D + (M-1)ZMAC 

NLMS based SPA (4(M -l)L + l)MAC+lD+lSq 1D + (M-1)ZMAC 



SG 



(4JVL + 5)MAC 



lD + lAbs + (2A£ + 2)MAC 



SG with LP 



(7M, + 4)MAC 



lD + lAbs + (2M. + 4)MAC 



FD 



NLMS ANC 



(10M-7-^f^) + 
(6M-2)log 2 2L MAC 



1D + (2M + 2)MAC 



NLMS based SPA 



14M-ll-^^ + 
(6M-2)log 2 2ZMAC 
+1/Z Sq + l/ZD 



1D + (2M + 2)MAC 
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SG (i8Af + 6-^f) + 

(Algorithm 1 ) (6N + 8) log 2 2L MAC 



lD + lAbs + (4AT + 4)MAC 



SG with LP 



(26N + A-^f-) 

+(6Af + 10)log 2 2ZMAC 



lD + lAbs + (4iV + 6)MAC 



(Algorithm 2) 



Table 1 



[0079] As an illustration, Fig. 9 plots the complexity (expressed as the number of Mega 
operations per second (Mops)) of the time-domain and the frequency-domain stochastic 
gradient algorithm with LP filter as a function of L for M=3 and a sampling frequency f s =16 
kHz. Comparison is made with the NLMS-based ANC of the GSC and the SPA. The 
complexity of the FD SPA is not depicted, since for small M, it is comparable to the cost of 
the FD-NLMS ANC. For L>8, the frequency-domain implementations result in a 
significantly lower complexity compared to their time-domain equivalents. The 
computational complexity of the FD stochastic gradient algorithm with LP is limited, making 
it a good alternative to the SPA for implementation in hearing aids. 

In Table 1 and Fig. 9 the complexity of the time-domain and the frequency-domain NLMS 
ANC and NLMS based SPA represents the complexity when the adaptive filter is only 
updated during noise only. If the adaptive filter is also updated during speech + noise using 
data from a noise buffer, the time-domain implementations additionally require NL MAC per 
sample and the frequency-domain implementations additionally require 2 FFT and (4L(M-1)- 
2(M-1)+L) MAC per L samples. 

[0080] The performance of the different FD stochastic gradient implementations of the 
SP-SDW-MWF is evaluated based on experimental results for a hearing aid application. 
Comparison is made with the FD-NLMS based SPA. For a fair comparison, the FD-NLMS 
based SPA is -like the stochastic gradient algorithms- also adapted during speech + noise 
using data from a noise buffer. 

[0081] The set-up is the same as described before (see also Fig. 5). The performance of 
the FD stochastic gradient algorithms is evaluated for a filter length L=32 taps per channel, 
p'=0.8 and y=0. To exclude the effect of the spatial pre-processor, the performance measures 
are calculated w.r.t. the output of the fixed beamformer. The sensitivity of the algorithms 



34 



Atty. Docket No. COCH 0185 US1 /Customer No. 22,506 Client Ref. No. CID 31 1 US 

Atty. Docket No. 22409-00388-US/ Customer No. 30,678 

against errors in the assumed signal model is illustrated for microphone mismatch, e.g. a gain 
mismatch Y 2 = 4 dB of the second microphone. 

[0082] Fig. 10(a) and (b) compare the performance of the different FD Stochastic Gradient 
(SG) SP-SDW-MWF algorithms without w 0 (i.e., the SDR-GSC) as a function of the trade- 
off parameter ju for a stationary and a non-stationary (e.g. multi-talker babble) noise source, 
respectively, at 90°. To analyse the impact of the approximation (eq.50) on the performance, 
the result of a FD implementation of (eq.49), which uses the clean speech, is depicted too. 
This algorithm is referred to as optimal FD-SG algorithm. Without Low Pass (LP) filter, the 
stochastic gradient algorithm achieves a worse performance than the optimal FD-SG 
algorithm (eq.49), especially for large 1///. For a stationary speech-like noise source, the FD- 
SG algorithm does not suffer too much from approximation (eq.50). In a highly time-varying 
noise scenario, such as multi-talker babble, the limited averaging of r[k] in the FD 
implementation does not suffice to maintain the large noise reduction achieved by (eq.49). 
The loss in noise reduction performance could be reduced by decreasing the step size p\ at 
the expense of a reduced convergence speed. Applying the low pass filter (eq.66) with e.g. 
1=0.999 significantly improves the performance for all \l\x, while changes in the noise 
scenario can still be tracked. 

[0083] Fig. 1 1 plots the SNR improvement ASNRj nt eiiig and the speech distortion SDi nte ni g 
of the SP-SDW-MWF (1/^=0.5) with and without filter wo for the babble noise scenario as a 
function of where k is the exponential weighting factor of the LP filter (see (eq.66)). 
Performance clearly improves for increasing k. For small k, the SP-SDW-MWF with wo 
suffers from a larger excess error -and hence worse ASNR irite iii g - compared to the SP-SDW- 
MWF without w 0 . This is due to the larger dimensions of E{yfyf ,H } . 

[0084] The LP filter reduces fluctuations in the filter weights W;[£] caused by poor 
estimates of the short-term speech correlation matrix E{yy' H } and/or by the highly non- 
stationary short-term speech spectrum. In contrast to a decrease in step size p\ the LP filter 
does not compromise tracking of changes in the noise scenario. As an illustration, Fig. 12 
plots the convergence behaviour of the FD stochastic gradient algorithm without w 0 (i.e. the 
SDR-GSC) for k=0 and k=0.9998, respectively, when the noise source position suddenly 
changes from 90° to 180°. A gain mismatch Y 2 of 4 dB was applied to the second 
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microphone. To avoid fast fluctuations in the residual noise energy e] and the speech 
distortion energy e], the desired and the interfering noise source in this experiment are 
stationary, speech-like. The upper figure depicts the residual noise energy e 2 n as a function of 
the number of input samples, the lower figure plots the residual speech distortion a] during 
speech + noise periods as a function of the number of speech + noise samples. Both 
algorithms (i.e., 1=0 and 1=0.9998) have about the same convergence rate. When the change 
in position occurs, the algorithm with 1=0.9998 even converges faster. For 1=0, the 
approximation error (eq.50) remains large for a while since the noise vectors in the buffer are 
not up to date. For 1=0.9998, the impact of the instantaneous large approximation error is 
reduced thanks to the low pass filter. 

[0085] Fig. 13 and Fig. 14 compare the performance of the FD stochastic gradient 
algorithm with LP filter (1=0.9998) and the FD-NLMS based SPA in a multiple noise source 
scenario. The noise scenario consists of 5 multi-talker babble noise sources positioned at 
angles 75°, 120°, 180°, 240°, 285° w.r.t. the desired source at 0°. To assess the sensitivity of the 
algorithms against errors in the assumed signal model, the influence of microphone 
mismatch, i.e. gain mismatch Y 2 =4dB of the second microphone, on the performance is 
depicted too. In Fig. 13, the SNR improvement ASNR inte iiig and the speech distortion SD int eiiig 
of the SP-SDW-MWF with and without filter w 0 is depicted as a function of the trade-off 
parameter l//u. Fig. 14 shows the performance of the QIC-GSC 

w fl w < fi 1 (equation 74) 

for different constraint values f5 2 , which is implemented using the FD-NLMS based SPA. 
The SPA and the stochastic gradient based SP-SDW-MWF both increase the robustness of 
the GSC (i.e., the SP-SDW-MWF without w 0 and 1/jU=0). For a given maximum allowable 
speech distortion SD inte iiig, the SP-SDW-MWF with and without w 0 achieve a better noise 
reduction performance than the SPA. The performance of the SP-SDW-MWF with wo is -in 
contrast to the SP-SDW-MWF without wo- not affected by microphone mismatch. In the 
absence of model errors, the SP-SDW-MWF with w 0 achieves a slightly worse performance 
than the SP-SDW-MWF without w 0 . This can be explained by the fact that with w 0 , the 
estimate of jE{y s y SJI ) is less accurate due to the larger dimensions of jE{y s y s ' H } (see also 
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Fig. 11). In conclusion, the proposed stochastic gradient implementation of the SP-SDW- 
MWF preserves the benefit of the SP-SDW-MWF over the QIC-GSC. 

Improvement 2 ; frequency-domain stochastic gradient algorithm using correlation 
matrices 

[0086] It is now shown that by approximating the regularisation term in the frequency- 
domain, (diagonal) speech and noise correlation matrices can be used instead of data buffers, 
such that the memory usage is decreased drastically, while also the computational complexity 
is further reduced. Experimental results demonstrate that this approximation results in a small 
-positive or negative- performance difference compared to the stochastic gradient algorithm 
with low pass filter, such that the proposed algorithm preserves the robustness benefit of the 
SP-SDW-MWF over the QIC-GSC, while both its computational complexity and memory 
usage are now comparable to the NLMS-based SPA for implementing the QIC-GSC. 

[0087] As the estimate of r[k] in (eq.51) proved to be quite poor, resulting in a large 
excess error, it was suggested in (eq. 59) to use an estimate of the average clean speech 
correlation matrix. This allows r[k] to be computed as 



with X an exponential weighting factor. For stationary noise a small A", i.e. 1/(1 — X) — NL~j 
1/(1- A ) ~ NL. suffices. However, in practice the speech and the noise signals are often 
spectrally highly non-stationary (e.g. multi-talker babble noise), whereas their long-term 
spectral and spatial characteristics usually vary more slowly in time. Spectrally highly non- 
stationary noise can still be spatially suppressed by using an estimate of the long-term 
correlation matrix in r[k], i.e. 1/(1 - A") » NL 1/(1- X ) » NL . In order to avoid expensive 
matrix operations for computing (eq.75), it was previously assumed that w[k] varies slowly in 
time, i.e. w[k]~w[l], such that (eq.75) can be approximated with vector instead of matrix 
operations by directly applying a low pass filter to the regularisation term r[k], cf. (eq.63), 





(equation 76) 




(equation 77) 
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However, this assumption is actually not required in a frequency-domain implementation, as 
will now be shown. 

[0088] The frequency-domain algorithm called Algorithm 2 requires large data buffers 
and hence the storage of a large amount of data (note that to achieve a good performance, 
typical values for the buffer lengths of the circular buffers Bi and B 2 are 10000... 20000). A 
substantial memory (and computational complexity) reduction can be achieved by the 
following two steps: 

• When using (eq.75) instead of (eq.77) for calculating the regularisation term, 
correlation matrices instead of data samples need to be stored. The frequency-domain 
implementation of the resulting algorithm is summarised in Algorithm 3, where 
2Zx2Z-dimensional speech and noise correlation matrices S, y [£] and 
S"j[k],i,j = M-N...M-\ are used for calculating the regularisation term R;[k] and 
(part of) the step size A[k]. These correlation matrices are updated respectively during 
speech + noise periods and noise only periods. When using correlation matrices, filter 
adaptation can only take place during noise only periods, since during speech + noise 
periods the desired signal cannot be constructed from the noise buffer B 2 anymore. 
This first step however does not necessarily reduce the memory usage (NL bu fi for data 
buffers vs. 2(NL) 2 for correlation matrices) and will even increase the computational 
complexity, since the correlation matrices are not diagonal. 

• The correlation matrices in the frequency-domain can be approximated by 
diagonal matrices, since Fk T kF l in Algorithm 3 can be well approximated by 1^/2. 
Hence, the speech and the noise correlation matrices are updated as 

Sy[k] = AS 9 [k - 1] + (1 - X)Y?[k]Yj[k]/2, (equation 78) 
S; [k] = AS; [k-l] + (l- X)Y;' H [k]YJ [k]/2 , (equation 79) 
leading to a significant reduction in memory usage and computational complexity, 
while having a minimal impact on the performance and the robustness. This algorithm 
will be referred to as Algorithm 4. 
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Algorithm 3 Frequency-domain implementation with correlation matrices (without 
approximation) 

Initialisation and matrix definitions: 

W,[0] = [0 ••• 0] T ,i = M-N...M-l 

P m [0] = S m ,m = 0...2L-l 

F = 2L x 2L -dimensional DFT matrix 

::]• -j 

0 L =LxL-dim. zero matrix, I L =LxL-dim. identity matrix 
For each new block of L samples (per channel): 

d[k] = [y 0 [kL-A] ••• y 0 [kL-A + L-l]f 

Y ; [A:] = diag{F[^.[^-Z] ••• y i [kL + L-l]] T ^,i = M -N ...M -I 
Output signal: 

e[k] = d[k]- kF ~ 1 £ Y,[*]W,[*1 E[k] = ¥k T e[k] 

j=M-N 

If speech detected: 

S..[k] = (1 - A)]T X kA Yf [/]Fk r kF- 1 Y y [/] = XS,..[k - 1] + (1 - X)Y? [A;]Fk r kF" 1 Y ; .[A:] 

1=0 

If noise detected: Y i [k] = Y?[k] 

S"j[k] = (1- A) J) A*-'Y / "' /f [/]Fk r ltF- 1 Y;[/] = AS,". [A: - 1] + (1 - X)Y"' H [&]Fk r kF _1 Y" [k] 

1=0 

Update formula (only during noise-only-periods): 

R,[*] = - Z [S,[*]-SJ[*]]W y [*],/ = M-tf...M-l 

^ y=M-iv 

W,[k + 1] = W,[it] + FgF _I A[it]{Y;^[itM*] - R,[Jt]} ,/ = M - N...M - 1 
A[*] = ^diagfp- 1 ^],...,^^]} 

P m [it] = yP m [k - 1] + (1 - y) (P Um [k] + P lm [kfj,m = 0...2Z-1 
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1»[*]= E Kl k f> P fW = - 2 S,Jk]-S;jk]\,m = 0...2L-l 

J=M—N A 1 \j=M-N j 

[0089] Table 2 summarises the computational complexity and the memory usage of the 
frequency-domain NLMS-based SPA for implementing the QIC-GSC and the frequency- 
domain stochastic gradient algorithms for implementing the SP-SDW-MWF (Algorithm 2 
and Algorithm 4). The computational complexity is again expressed as the number of Mega 
operations per second (Mops), while the memory usage is expressed in kWords. The 
following parameters have been used: M=3, L=32, f s =16kHz, L bufl =10000, (a) N=M-1, (b) 
N=M. From this table the following conclusions can be drawn: 

• The computational complexity of the SP-SDW-MWF (Algorithm 2) with filter 
w 0 is about twice the complexity of the QIC-GSC (and even less if the filter w 0 is not 
used). The approximation of the regularisation term in Algorithm 4 further reduces 
the computational complexity. However, this only remains true for a small number of 
input channels, since the approximation introduces a quadratic term 0(N 2 ) . 

• Due to the storage of data samples in the circular speech + noise buffer Bi, the 
memory usage of the SP-SDW-MWF (Algorithm 2) is quite high in comparison with 
the QIC-GSC (depending on the size of the data buffer Lbufi of course). By using the 
approximation of the regularisation term in Algorithm 4, the memory usage can be 
reduced drastically, since now diagonal correlation matrices instead of data buffers 
need to be stored. Note however that also for the memory usage a quadratic term 
0(N 2 ) is present 

Algorithm 

NLMS based SPA 

SG with LP 
(Algorithm 2) 



Computational complexity Mops 
update formula step size 

adaptation 

(14M-ll-^)+ (2M + 2)MAC 2.16 
(6M-2)log 2 2ZMAC +1D 
+l/ZSq + l/LD 

(26N + 4-^f) + (4iV + 6)MAC 3.22 (a) , 4.27 (b) 

(6A^ + 10)log 2 2ZMAC +lD + lAbs 
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SG with correlation 



(l(W 2 +13Af-^v)+ (2iV + 4)MAC 2.71 (a) , 4.31 ( 
(6A^ + 4)log 2 2ZMAC +lD + lAbs 



matrices 



(Algorithm 4) 



NLMS based SPA 



Memory usage 

A(M-\)L + 6L 



kWords 



0.45 



SG with LP 



2NL W +6LN + 1L 



40.61 (a) , 60.80 (b) 



(Algorithm 2) 



SG with correlation 



ALN 2 +6LN + 1L 



1.12 (a) , 1.95 (b) 



matrices 



(Algorithm 4) 



Table 2 



[0090] It is now shown that practically no performance difference exists between 
Algorithm 2 and Algorithm 4, such that the SP-SDW-MWF using the implementation with 
(diagonal) correlation matrices still preserves its robustness benefit over the GSC (and the 
QIC-GSC). The same set-up has been used as for the previous experiments. 

The performance of the stochastic gradient algorithms in the frequency-domain is evaluated 
for a filter length L=32 per channel, p'=0.8, y=0.95 and 1=0.9998. For all considered 
algorithms, filter adaptation only takes place during noise only periods. To exclude the effect 
of the spatial pre-processor, the performance measures are calculated with respect to the 
output of the fixed beamformer. The sensitivity of the algorithms against errors in the 
assumed signal model is illustrated for microphone mismatch, i.e. a gain mismatch Y 2 = 4dB 
at the second microphone. 

[0091] Fig. 15 and Fig. 16 depict the SNR improvement ASNRnteiiig and the speech 
distortion SD inte iiig of the SP-SDW-MWF (with w 0 ) and the SDR-GSC (without w 0 ), 
implemented using Algorithm 2 (solid line) and Algorithm 4 (dashed line), as a function of 
the trade-off parameter l/ju. These figures also depict the effect of a gain mismatch Y 2 =4 
dB at the second microphone. From these figures it can be observed that approximating the 
regularisation term in the frequency-domain only results in a small performance difference. 
For most scenarios the performance is even better (i.e. larger SNR improvement and smaller 
speech distortion) for Algorithm 4 than for Algorithm 2. 
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[0092] Hence, also when implementing the SP-SDW-MWF using the proposed Algorithm 
4, it still preserves its robustness benefit over the GSC (and the QIC-GSC). E.g. it can be 
observed that the GSC (i.e. SDR-GSC with l/ju=0) will result in a large speech distortion 
(and a smaller SNR improvement) when microphone mismatch occurs. Both the SDR-GSC 
and the SP-SDW-MWF add robustness to the GSC, i.e. the distortion decreases for increasing 
l/ju. The performance of the SP-SDW-MWF (with w 0 ) is again hardly affected by 
microphone mismatch. 
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